On the Tomography of Networks and Multicast Trees 
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Abstract 

In this paper we model the tomography of scale free 
networks by studying the structure of layers around 
an arbitrary network node. We find, both analytically 
and empirically, that the distance distribution of all 
nodes from a specific network node consists of two 
regimes. The first is characterized by rapid growth, 
and the second decays exponentially. We also show 
that the nodes degree distribution at each layer is a 
power law with an exponential cut-off. We obtain 
similar results for the layers surrounding the root of 
multicast trees cut from such networks, as well as 
the Internet. All of our results were obtained both 
analytically and on empirical Interenet data. 



1 Introduction 

In recent years there is an extensive effort to model 
the topology of the Internet. While the exact nature 
of the Internet topology is in debate [4 ], it was found 
that many realistic networks posses a power law, or 



scale free degree distribution fTTI . These results 
were also verified by IIT21 IT4l 151 [51 . who conducted 
further investigations. Albert and Barabasi |2] ^ 
suggested a dynamic graph generation model that 
generates such networks. One of their main find- 
ings was the self similarity characteristic of such net- 
works. Interestingly, empirical findings on partial 
views obtained similar results, which may lead to the 
assumption that due to the self similarity nature of 
the Internet structure, this characteristic would be ex- 
posed through different cuts and filters. 

In this paper we study the tomography of 
scale free networks and multicast trees embedded on 
them. We use the Molloy Reed graph generation 
method [15| in conjunction with similar techniques 
to study the layer structure (tomography) of net- 
works. Specifically, we study the number and degree 
distribution of nodes at a given (shortest path) dis- 
tance from a chosen network node. We show analyt- 
ically that the distance distribution of all nodes from 
a specific network node consists of two regimes. The 
first can be described as a very rapid growth, while 
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the second is found to decay exponentially. We also 
show that the node degree distribution at each layer 
obeys a power law with an exponential cut-off. We 
back our analytical derivations with simulations, and 
show that they match. 

We also study shortest path trees cut from scale 
free networks, as they may represent multicast trees. 
We investigate their layer structure and distribution. 
We show that the structure of a multicast tree cut 
from a scale free network exhibits a layer behavior 
similar to the network it was cut from. We validate 
our analysis with simulations and real Internet data. 

The paper is organized as follows. Section|2]de- 
tails previous findings and gives the basic terminol- 
ogy we use in the paper. In Section [3] we introduce 
the process used for generating scale free graphs and 
their layers. Then, we analyze the resulting tomogra- 
phy of such networks, and back the results with sim- 
ulations and real data. In Section |5] we investigate 
the tomography of multicast trees cut from such net- 
works, and back our findings with real Internet data. 

2 Background 

2.1 Graph Generation 

In recent years studies have shown that many real 
world networks, and, in particular, the Internet, are 
scale free networks. That is, their degree distribution 
follows a power law, P(k) = ck~ x , where c is an ap- 
propriate normalization factor, and A is the exponent 
of the power law. 

Several techniques for generating such scale 
free graphs were introduced |2] [T3Tl . Molloy and 
Reed suggested in |15| a method (MR model) for 
computing the size of the giant (or largest) compo- 
nent in a scale free network. To do so, they developed 
the following method. A graph with a given degree 
distribution is generated out of the probability space 
(ensemble) of possible graph instances. For a given 
graph size N, the degree sequence is determined by 
randomly choosing a degree for each of the N nodes 
from the degree distribution. Let us define V as the 
set of N chosen nodes, C as the set of unconnected 
outgoing links from the nodes in V, and E as the set 
of edges in the graph. Initially, E is empty. Then, 
the links in C are randomly matched, such that at the 
end of the process, C is empty, and E contains all 



the matched links < u, v >, u, v £ V. Throughout 
this paper, we refer to the set of links in C as open 
connections. 

Note, that while in the BA model the graph de- 
gree distribution function exists only at the end of the 
process, in the MR model the distribution is known 
apriori, thus enabling us to use it in our analysis dur- 
ing the construction of the graph. 



2.2 Cut-Off Effect 

Recent work |7], has shown that the radius 1 , r, of 
scale free graphs is extremely small and scales as r ~ 
log log N. The meaning of this is that even for very 
large networks, finite size effects must be taken into 
account, because algorithms for traversing the graph 
will get to the network edge after a small number of 
steps. 

Since the scale free distribution has no typical 
scale, its behavior is influenced by externally im- 
posed cutoffs, i.e. minimum and maximum values 
for the allowed degrees, k. The fraction of sites 
having degrees above and below the threshold is as- 
sumed to be 0. The lower cutoff, m, is usually cho- 
sen to be of order 0(1), since it is natural to assume 
that in real world networks many nodes of interest 
have only one or two links. The upper cutoff, K, can 
also be enforced externally (say, by the maximum 
number of links that can be physically connected to a 
router). However, in situations where no such cutoff 
is imposed, we assume that the system has a natural 
cutoff. 

To estimate the natural cutoff of a network, we 
assume that the network consists of N nodes, each of 
which has a degree randomly selected from the dis- 
tribution P(k) = ck~ x . An estimate of the average 
value of the largest of the N nodes can be obtained 
by looking for the smallest possible tail that contains 



'We define the radius of a graph, r, as the average distance 
of all nodes in the graph from the node with the highest de- 
gree (if there is more than one we will arbitrarily choose one 
of them). The average hop distance or diameter of the graph, d, 
is restricted to: 

r < d < 2r, (1) 

Thus the average hop sequence is bound from above and from 
below by the radius. 
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a single node on the average [ 6 ] : 

V P(k) rj / P(A:)dA: = l/N. (2) 
feti ■/* 

Solving the integral yields K rj mJV 1 /'^ 1 ), which 
is the approximate natural upper cutoff of a scale free 
network EOS ED- 

In the rest of this paper, in order to simplify the 
analysis presented, we will assume that this natural 
cutoff is imposed on the distribution by the exponen- 
tial factor P(k) 



ck~ x e- k / K . 



Tomography of Scale Free Net- 
works 



In this section we study the statistical behavior of 
chemical layers surrounding the maximally con- 
nected node in the network. First, we describe the 3.2 Analysis 
process of generating the network, and define our ter- 
minology. Then, we analyze the degree distribution 
at each layer surrounding the maximally connected 
node. 



K, and connect it randomly to K available open con- 
nections, thus removing these open connections from 
C. We have now exposed the first layer (or shell), 
indexed as Z = 1. We now continue to fill out the 
second layer I = 2 in the same way: We connect all 
open connections emerging from nodes in layer No. 
1 to randomly chosen open connections. These open 
connections may be chosen from layer No. 1 (thus 
creating a loop) or from othe links in C. We con- 
tinue until all open connections emerging from layer 
No. 1 have been connected, thus filling layer I = 2. 
Generally, to form layer I + 1 from an arbitrary layer 
I, we randomly connect all open connections emerg- 
ing from I to either other open connections emerging 
from I or chosen from the othe links in C. Note, that 
when we have formed layer l + l, layer I has no more 
open connections. The process continues until the set 
of open connections, C, is empty. 



3.1 Model Description 

We base our construction on the Molloy-Reed 
model fi31. also described in |2 The construction 
process tries to gradually expose the network, fol- 
lowing the method introduced in [7 1, and is forcing a 
hierarchy on the Molloy-Reed model, thus enabling 
us to define layers in the graph. 

We start by setting the number of nodes in 
the network, N. We then choose the nodes de- 
grees according to the scale-free distribution func- 
tion P(k) = ck~ x , where c « (A — l)m A_1 is the 
normalizing constant and k is in the range [m,K], 
for some chosen minimal degree m and the natural 
cutoff K = mN 1 /^- 1 ^ of the distribution EH. 

At this stage each node in the network has a 
given number of outgoing links, which we term open 
connections, according to its chosen degree. Note, 
that according to the terminology in|5J the set of links 
in E is empty at this point, while the set of outgoing 
open links in C contains all unconnected outgoing 
links in the graph. We proceed as follows: we start 
from the maximal degree node, which has a degree 



We proceed now to evaluate the probability for nodes 
with degree k to reside in any of the layers layer 
{i\i > 1} for some I, denoted by Pi(k). 

The number of open connections outside layer 
No. I, is given by: 



Ti 



N^kPiik) 

k 



(3) 



Thus, we can define the probability that a de- 
tached node with degree k will be connected to an 
open connection emerging from layer I by , 
where xi is the number of open connections emerg- 
ing from layer I. 

Therefore, the conditional probability for a 
node with degree k not to be also in layer I + 1, given 
that it cannot connect to any of the \i open connec- 
tion emerging from layer Z, is: 



P{k,l + \\l) 



1 Xl 



Xi + Ti 



k 



exp 



1 + 



(4) 



XI 



For large enough values of xi- 

The probability that a node of degree k will be 
outside layer No. Z + 1 is: 
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(a) 



' 4 /y\ 




Figure 1: Illustration of the exposure process. The large 
circles denote exposed layers of the giant component, 
while the small circles denote individual sites. The sites 
outside the circles have not been reached yet. (a) We be- 
gin with the highest degree node and fill out layer No.l. 
(b) In the exposure of layer No. I + 1 any open connection 
emerging from layer No. I may connect to any open node 
(Ti connections) or loop back into layer No. I (\i con- 
nections), (c) The number of connections emerging from 
layer No. I + 1 is the difference between T; and TJ+i after 
reducing the incoming connections Si+i from layer No. 



P l+1 (k)=P l (k)P(k,l + l\l) 

k 



Pi{k)exp 



1 + 



(5) 



XI 



Thus we derive the exponential cutoff: 

P l {k)=P{k)exp(-^ S j (6) 



Where : 



K l+1 



(V) 



An alternate method for deriving the above re- 
lationship is given in Appendix A. 

Now let us find the behavior of xi and Si, where 
Si is the number of links incoming to the I + 1 
layer (and approximately equals JVj.fi, the number 
of nodes in the I + 1 layer). The number of incom- 
ing connections to layer I + 1 equals the number of 
connections emerging from layer I, minus the num- 
ber of connections looping back into layer No. I. The 
probability for a connection to loop back into layer I 
is: 



P(loop\l) 



Xl 



Xi + Ti 



(8) 



and Therefore: 



s 



l+l 



Xl i 



XI 



Xi+Ti 



(9) 



The number of connections emerging from all 
the nodes in layer No. l+l is I)— This includes 
also the number of incoming connections from layer 
I into layer I + 1, which is equal to Si + \. Therefore: 



Xi+i 



'-i+i 



s 



l+l 



(10) 



At 



this point we have the following rela- 
tions: Ti + i(Ki + i) Eq. © and Eq. ©, 
Si +1 ( X l,Ti) Eq. ©, K l+1 (K hX l,Ti) Eq. 0, and 
X i+i(T h Ti +1 ,Si +1 ) Eq. © and {TOJ. These rela- 
tions may be solved numerically. Note that approxi- 
mate analytical results for the limit JV — > oo can be 
found in ll7l [T0"l . 
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Number of nodes in each layer: X-Y plot 
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Number of nodes in each layer: semi-log plot 
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Figure 2: Si vs. layer index I for a network with N = 10 6 
nodes, A = 2.85, and to = 1. Symbols represent simu- 
lation results while black lines are a numerical solution 
for the derived recursive relations. From the semi-log plot 
we see that there is an exponential decay of Si for layers 
I > L starting from a given layer L which we believe is 
related to the radius of the graph. 

4 Empirical Results 

Figure El shows results from simulations (colored 
symbols) for the number of nodes at layer I, which 
can be seen to be in agreement with the analytical 
curves of Si (lines). We can see that starting from a 
given layer I = L the number of nodes decays expo- 
nentially. We believe that the layer index L is related 
to the radius of the graph [7]. It can be seen that 
Si is a good approximation for the number of nodes 
at layer I. This is true in cases when only a small 
fraction of sites in each layer / have more than one 
incoming connection. An example for this case is 
when m = 1 so that most of the sites in the network 
have only one connection. Figure|3]shows results for 
Pi(k) with similar agreement. 

It is important to note that the simulation results 
give the probability distribution for the percolation 
cluster, while the analytical reconstruction gives the 
probability distribution for the whole graph. This ex- 
plains the difference in the probability distributions 
for lower degrees: many low degree nodes are not 
connected to the percolation cluster and therfore the 
probability distribution derived from the simulation 
is smaller for low degrees. 

Figure 0] and figure [5] show the same analy- 



Degree Distribution of Layers: log-log plot 




log(k) 

Figure 3: log-log plot of Pi(k) for different layers I = 
0, 1, 2, for a network with N = 10 6 nodes, A = 2.85, 
and to = 1. Symbols represent simulation results while 
black lines are a numerical solution for the derived recur- 
sive relations. 



sis for a cut of the internet at router level (lucent 
routers). The actual probability distribution is not 
a pure power law, rather it can be approximated by 
A = 2.3 for small degrees and A = 3 at the tail. 
Our analytical reconstruction of the layer statistics 
assumes A = 3, because the tail of a power law 
distribution is the important factor in determining 
properties of the system. This method results in a 
good reconstruction for the number of nodes in each 
layer, and a qualitative reconstruction of the proba- 
bility distribution in each layer. 

In general, large degree nodes of the network 
mostly reside in the lower layers, while the layers 
further away from the source node are populated 
mostly by low degree nodes. This implies that the 
tail of the distribution affects the lower layers, while 
the distribution function for lower degrees affects the 
outer layers. Thus the deviations in the analytical re- 
construction of the number of nodes per layer for the 
higher layers may be attributed to the deviation in the 
assumed distribution function for low degrees (that 
is: A = 3 instead of A = 2.3). 

Our model does not take into account the corre- 
lations in node degrees, which were observed in the 
internet 1171 . and hierarchichal structures [19]. This 
may also explain the deviation of our measurments 
from the model predictions. 
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5 Empirical Findings on the Tomog- 
raphy of Multicast Trees 




Figure 4: number of nodes at each layer for a router 
level cut of the internet with N — 112, 969 nodes (Lucent 
routers). Analytical reconstruction is done with A = 3, 
and m = 1. 



Degree Distribution of Layers: log-log plot 




0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2 
log(k) 



Figure 5: log-log plot of Pi(k) for different layers 
I = 0,1,2,..., for a router level cut of the internet with 
N = 112, 969 nodes (Lucent routers). Qualitative analyt- 
ical reconstruction is done with A = 3, and m = 1. 



In this section, we detail some of our findings on 
the structure and characteristics of the depth rings 
around the root node of shortest path trees. All of our 
findings were also validated on real Internet data. 

5.1 Topology and Tree Generation 

Our method for producing trees is the following. 
First, we generate power law topologies based on the 
Notre-Dame model The model specifies 4 pa- 
rameters: ao, a, p and q 2 . Where ao is the initial 
number of detached nodes, and a is the initial con- 
nectivity of a node. When a link is added, one of 
its end points is chosen randomly, and the other with 
probability that is proportional to the nodes degree. 
This reflects the fact that new links often attach to 
popular (high degree) nodes. The growth model is 
the following: with probability p, a new links are 
added to the topology. With probability q, a links are 
rewired, and with probability 1 — p — q a new node 
with a links is added. Note that a, p and q determine 
the average degree of the nodes. We created a vast 
range of topologies, but concentrated on several pa- 
rameter combinations that can be roughly described 
as very sparse (VS), Internet like sparse (IS) and less 
sparse (LS). Table [2 summarizes the main character- 
istics of the topologies used in this paper. 

From these underlying topologies, we create the 
trees in the following manner. For each predeter- 
mined size of client population we choose a root 
node and a set of clients. Using Dijkstra's algo- 
rithm we build the shortest path tree from the root to 
the clients. To create a set of trees that realistically 
resemble Internet trees, we defined four basic tree 
types. These types are based on the rank of the root 
node and the clients nodes. The rank of a node is its 
location in a list of descending degree order, in which 
the lowest rank, one, corresponds to the node with 
the highest degree in the graph. For the case of a tree 
rooted at a big ISP site, we choose a root node with 
a low rank, thus ensuring the root is a high degree 
node with respect to the underlying topology. Then, 
we either choose the clients as high ranked nodes, or 
at random, as a control group. Note, that due to the 

2 The notations in 1 1 1 are mo, m, p and q. 
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Name 


Type 


Parameters 


No. of Nodes 


Avg. Node degree 


VS 


generated 


a= l;p <E : 0.05 : 0.5 


10000 


1.99 - 3.98 


IS 


generated 


a = 2;p G : 0.05 : 0.5 


10000 


3.99 - 7.9 


LS 


generated 


a = 3;p£0: 0.05 : 0.5 


10000 


5.98 - 12.04 


Big IS 


generated 


a = 1.5, 2;p = 0.1 


50000; 100000 


3.3,4-4 


BL[1,2] 


real data 




Internet 


3.2 3 


LC 


real data 




Internet 


3.2 4 



Table 1 : Type of underlying topologies used 



characteristic of the power law distribution, a random 
selection of a rank has a high probability of choosing 
a low degree node. The next two tree types have a 
high ranked root, which corresponds to a multicast 
session from an edge router. Again, the two types 
differ by the clients degree distribution, which is ei- 
ther low, or picked at random. 

The tree client population is chosen at the range 
[50, 4000] for the 10000 node generated topology, 
[50, 10000] for the 100000 node generated topology, 
and [500, 50000] for the trees cut from real Internet 
data. For each client population size, 14 instances 
were generated for each of the four tree types. All 
of our results are averaged over these instances. The 
variance of the results was always negligible. 

There are two underlying assumptions made in 
the tree construction. The first, is that the multicast 
routing protocol delivers a packet from the source to 
each of the destinations along a shortest path tree. 
This scenario conforms with current Internet routing. 
For example, IP packets are forwarded based on the 
reverse shortest path, and multicast routing protocols 
such as Source Specific Multicast [ 13] deliver pack- 
ets along the shortest path route. In addition, we as- 
sume that client distribution in the tree is uniform, as 
has been shown by fi8ll3ll. 

5.2 Tree Characteristics 

Our results show that trees cut from a power law 
topology obey a similar power law for the degree 
distribution, as well as the sub-trees sizes [8]. The 
results were shown to hold for all trees cut from all 
generated topologies, even for trees as small as 200 
nodes. 

In this work we further investigated the tomog- 
raphy of the trees, and looked at the degree distri- 



bution of nodes at different depth rings around the 
root, i.e., tree layers. It was rather interesting to ob- 
serve that any layer with sufficient number of nodes 
to create a valid statistical sample obeyed a degree- 
frequency relationship which was similar to a power 
law, although with different slopes. We suspect that 
this is due to the exponential cut-off phenomenon 
discussed in the previous sections. Figure |6] shows 
this for the third layer around the root (i.e., nodes 
at distance three from the root) of a 300 client tree 
cut from a big IS topology (100000 nodes). The root 
was chosen with a high degree, and the clients with 
a low degree. Although the number of nodes is quite 
small, we see a very good fit with the power law. Fig- 
ure shows an excellent fit to the power law for the 
fifth layer around the root of a 10000 client tree, cut 
from the same topology. This phenomenon is stable 
regardless of the tree type, and the client population 
size. 

To understand the exact relationship of the 
degree-frequency at different layers, we plotted 
the distribution of each degree at different layers. 
Cheswick at al. [ 5 ] found a gamma law for the num- 
ber of nodes at a certain distance from a point in the 
Internet. Our results show that the distribution of 
nodes of a certain degree at a certain distance (layer) 
from the root seems close to a gamma distribution, 
although we did not determine its exact nature. Fig- 
ure [8] shows the distribution of the distance of two 
degree nodes, and Figure[9]fhe distribution of the dis- 
tance of high degree nodes, i.e., nodes with a degree 
six and higher. In both figures the root is a low de- 
gree node, and the tree has 1000 low degree clients. 
As can be seen, the high degree nodes tend to reside 
much closer to the root than the low degree nodes, 
and in adjacent layers. In this example, most of them 
are in the second to forth layers around the root, with 
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Frequencies of Degrees: 1 0000 users, Depth ring 5 



Line: Y=-6.28 X + 5.58. ACC=0.9965 
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Figure 6: Third layer of a 300 client tree cut from Figure 7. Fifth layer of a 10000 client tree cut from 
topology a = 6, a = 1.5, p = 0.1, q = topology a = 6, a = 1.5, p = 0.1, q = 



only two more at layer five. This phenomenon was 
even more obvious when the root was a high degree 
node. 

the distribution of the lengths of the paths to the 
clients. Our results show that the less connected the 
underlying topology, the higher is the average tree 
cut from the topology. For a 10000 node underlying 
topology with an average degree of three and higher, 
the height of the trees was not more than ten. On 
an underlying topology of 100000 nodes, the height 
of the trees was not more than 12. In accordance 
with our findings of a 'core' of high degree nodes, 
the trees were higher on the average when the root 
was a low degree node, compared to trees with a high 
degree root. 

We verify the above findings with results ob- 
tained from a real Internet data set. Since we have 
no access to multicast tree data we use the client 
population of a medium sized web site with scien- 
tific/engineering content. This may represent the po- 
tential audience of a multicast of a program with sci- 
entific content. Two lists of clients were obtained, 
and traceroute was used to determine the paths from 
the root to the clients. It is important to note, that 
the first three levels of the tree consist of routers 
that belong to the site itself, and therefore might be 
treated as the root point of the tree, although in these 
graphs they appear separately. Figure [TU] shows the 
frequency of degrees in the tree. The linear fit of 



the log-log ratio is excellent, with a correlation co- 
efficient of 0.9829. The exponent is very close to 
the exponent we derived for trees cut from topolo- 
gies that resemble the Internet. Figures and [Ol 
show the frequency of degrees at layers 5 and 10 of 
the tree, respectively. They conform with our finding 
that the power law of frequency-degree is maintained 
for each separate distance around the root. 

6 Conclusions 

We define a "layer" in a network as the set of nodes 
at a given shortest path distance from a chosen node. 
We find that the degree distribution of the nodes at 
each layer obeys a power law with an exponential 
cutoff. We also model the behavior of the number of 
nodes at each layer, and explain the observed expo- 
nential decay in the outer layers of the network. 
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Figure 10: Frequency of degrees of the Internet tree. 



Bell-Labs Frequencies of Degrees for Fifth Depth Ring 
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Figure 11: Frequency of degrees at layer 5 of the 
Internet tree. 
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Figure 12: Frequency of degrees at layer 10 of the 
Internet tree. 
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Appendix A 

Deriving Pi(k) Using Mean Field Approximation 

Each node is treated independently, where the in- 
teraction between nodes is inserted through the expected 
number of incoming connections. At each node, the pro- 
cess is treated as equivalent to randomly distributing \i 
independent points on a line of length \i + Ti and count- 
ing the resultant number of points inside a small interval 
of length k. Thus, the number of incoming connections 
ki n from layer I to a node with k open connections is dis- 
tributed according to a Poisson distribution with: 

k 

<hn>= -7WXI (11) 

Xl + n 

and : 



P l+ i(k m \k) = e-< k -> <k l n > k * n (12) 

Kin- 

The probability for a node with k open connections 
not to be connected to layer I, i.e. to be outside layer I + 1 
also, is: 



P(k,l + l\l) = P l+1 (k ln = 0\k) = e - <k -> = 

Thus the total probability to find a node of degree k 
outside layer / + 1 is: 



P l+1 (k)=P l (k)P(k,l + l\l) = Pi(k)exp 

i -- 

Xl 

(14) 

And we receive an exponential cutoff. 
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